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Abstract 

In this paper, we report on the design and implementation of a state-of-the-art Student Information 
System (SIS) being developed in a moderate size Alberta, Canada school jurisdiction. The SIS 
design is premised upon transparency, balanced, comprehensive, and multi-method assessments that 
link qualitative and quantitative data in support of enhanced, evidence-based instructional 
leadership. Practical examples of data analytic strategies are discussed in relationship to educational 
leadership enhancement. The article concludes that as SIS design evolves more optimal, data- 
informed supports for student learning will be realized. 
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Rocky View Schools (RVS) is a school jurisdiction with approximately 18,000 students in 
Alberta, Canada. The RVS 2011-14 Three-Year Education Plan directs staff to “Develop a system- 
wide, balanced, and integrated student information system that supports instant [timely] diagnostics 
of individual student achievement, as well as aggregated data at the classroom, school, and 
jurisdictional levels” (Rocky View Schools, 2011). Development of a comprehensive and balanced 
Student In formation System (SIS) represents a fundamental investment of time and staff resources. 
The desired outcome related to the development of a SIS is enhanced school and system student 
diagnostics that will support educational leadership and action research focused on achieving higher 
degrees of student success. Demonstrating that this outcome is achievable is necessary to convince 
staff and stakeholders that the required implementation investment is warranted. 

Related Research 

The RVS Strategy to develop the SIS is premised upon an emerging focus of educational 
research pointing to the importance of student information systems that are transparent, multi¬ 
method, balanced, comprehensive, and directly linked to educational and instructional leadership. 
Educational excellence requires transparent and open education systems that use data and evidence 
to build partnerships with students, parents and communities in moving schools to higher 
performance (Fullan, Hill & Crevola, 2006). An example of timely, strategic and effective use of 
student data is suggested by Allignton, (2011, p. 41) who observes, “We could know on the second 
day of kindergarten who is at risk of becoming a struggling reader, but we typically do nothing with 
this information.” 

Black and Wiliam’s (1998) meta-analysis of student assessment studies builds on earlier 
research (Bloom, 1980) and has demonstrated that balanced student assessment premised on 
formative assessment linked to effective teaching methods and appropriate summative assessment 
with active feedback to students, teachers and parents are key to effective pedagogy. The 
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development of balanced models of student assessment is premised on capturing comprehensive 
student data generated by classroom assessment triangulated with other useful student data. Rocky 
View Schools is actively following up on this research with the view to institutionalize balanced 
assessment models through the development and implementation of Policy HK, Assessment and 
Communication of Student Learning (see 

http://www.rockyview.ab.ca/board policies/boardpolicies/curriculum/HK-Assessment- 

CommunicationofStudentLeaming20090604.pdf/view) . 

Supportive of the RVS approach to more balanced and holistic student assessment models, 
Parrilla, McQuarrie, Klassen, Georgiou & Odishaw (2010) have suggested that contextually 
sensitive and comprehensive student data and evidence-informed decision-making are central 
components of effective school leadership. They have observed, when considering data on students’ 
literacy achievement, that “...the methodological concerns with the evidence underline the 
importance of local assessment of the effectiveness, and implementation quality, of any reading 
interventions that are undertaken in schools” (p.66). Essentially their observation aligns with 
Buzick and Cahalan-Laitusis's research (2010) that supports the conclusion that organizational 
efficacy can be improved through proactive and transparent school and system response to 
accountability results - processes that are enhanced with strong student information systems. 

These research-based observations suggest that schools need rich data to make well informed 
decisions, not only about what is working or not working, but also to identify specific strategies 
premised on a full and balanced picture of students, including their learning needs, aspirations, 
abilities, attitudes and interests. As Couture (2011, p. 38) has observed, “to foster school cultures of 
creativity and ingenuity in Alberta we must build on the strength of an already strong teacher force 
by supporting ongoing school-based research and innovation, and continually pushing the limits of 
sound teaching practice, curriculum design and school development.” Extrapolating Couture’s 
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observations and building on the “action research” focus of Cycle Five of the Alberta Initiative on 
School Improvement would suggest that Alberta schools are entering a world where student data will 
fuel a new era of enhanced data generation and analysis. 

Supplemental student achievement data is readily available by tapping into a rich source of 
data - the classroom assessments that are compiled throughout the school year. It has been estimated 
that a student through 12 years of schooling will experience 600 classroom-based summative 
assessments compared to approximately 16 summative assessments based on external instruments. 
Incorporating classroom-based achievement data into a comprehensive student information database 
can open doors to greater data richness, added relevance, deeper meaning and resultant enhanced 
teacher ownership of student achievement improvement strategies (Burger, Nadirova, & Besenski, 
2011). One caveat, however, is that comprehensive models of classroom assessment should be based 
on a balance between formative and summative as well as criterion-referenced and norm-referenced 
assessments, but the bulk of classroom assessment ideally should be formative, criterion-referenced 
and authentic (Burger & Krueger, 2003). 

Balanced Assessment Models 

Teachers need to know their students individually and in terms of group dynamics to better 
meet their students’ needs as learners. This means not only multiple sources of data are necessary, 
but also both quantitative and qualitative methods. Emerging assessment tools and technologies 
should be incorporated into student assessment practice in order to advance efficacy and establish 
meaningful and useful linkages between external assessment resources and ongoing, classroom- 
based assessment. External, often commercially produced, assessment instruments that can produce 
useful, triangulated data are discussed next. 
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External Achievement Tests 

Criterion referenced tests such as the Alberta Provincial Achievement Tests (PATs) or norm- 
referenced tests such as the Canadian Achievement Test provide useful benchmarks of student 
achievement for different purposes and provide complementary pictures of student learning. Being 
criterion-referenced, the Alberta PATs give a good indication of how well a student has learned the 
intended outcomes of the Alberta Program of Studies. Norm-referenced achievement tests, on the 
other hand, compare a student’s level of achievement in core curricular subjects compared to his or 
her peers. Also, classical test theory tells us that no test is perfectly reliable or valid; hence, all test 
data must be interpreted in light of the test confidence intervals and relative to triangulated and trend 
data to have a clearer sense of how accurate and informative any test result may be. 

Ability Tests 

Ability tests such as the Canadian Test Centre’s Insight 
( http://www.canadiantcstccntrc.com/insight/insight.asp) can be group administered. Group 
administered IQ tests are less reliable but less costly than individually administered tests such 
as the Wechsler Scales (WISC-III, WPPSI-R). However, as Salvia and Yesseldyke (2004) 
note, these instruments can provide useful information regarding whether student cohorts are 
achieving to their potential and can provide some preliminary insight into individual 
students’ relative verbal and performance abilities thus informing teaching and learning 
strategies. 

Aptitude Tests 

Aptitude tests are less widely recognized and used, but provide useful information on 
what programs may best fit a student in high school or post-secondary learning. The 
Differential Aptitude Test (DAT) is a good example of an instrument that provides timely 
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information at key points in a student’s program decision-making 
(http://www.creativeorgdesign.com/tests page.htm?id=84) . 

Interest Inventories 

Instruments that measure student interests, such as the Safran Student’s Interest 
Inventory (http://career.nelson.com/ceg/safran.html ) or more sophisticated computer-based 
career planning-interest assessments such as the Web 2.0 based resource myBlueprint 
(http://www.mvblueprint.ca/discovery-explorations/) provide important information that 
give insight into what turns students on to learning. When linked to attitude and aptitude 
assessment data, information on a student’s interests can enable teachers and counselors to 
evolve a more refined picture of how to optimize education programs to maximize a 
student’s motivation and success. One RVS high school, Bert Church, has completed a pilot 
using the myBlueprint resource and is reporting very positive results and a commitment to 
proceed to school-wide implementation. 

Attitude Assessment 

There is considerable accumulating evidence on the importance of emotions and 
emotional competencies in student learning (Collaborative for Academic, Social and 
Emotional Learning, 2003; Durlak, Weissberg, Dymnicki, Taylor, & Schellinger, 2011; 
Parker, Saklofske, Wood, & Collin, 2009). Recent research on the development and internal 
measurement properties of a new instrument, the Student Orientation to School Questionnaire 
(SOS-Q), designed to provide comprehensive, yet succinct assessment of core facilitators of 
engagement and persistence from the student-centered perspective was reported by Burger, 
Nadirova and Keefer (2012). 

In summary, when considered comprehensively, external assessment data that captures 
a student’s achievement in criterion and norm-referenced contexts in combination with ability 
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indicators, aptitude measures, and attitude and interest indicators can provide powerful data 
sets that complement and add enhanced understanding to a student’s assessment profile that 
emerges from solely classroom-based assessment. 

Recent Non-Cognitive Assessment Research 

Attitudes linked to motivation can affect achievement early in a student’s experience 
of schooling. In her recent ethnographic study of a southeastern United States kindergarten 
class, Hatt (2012) investigated students’ evolving concept of “smartness... tied to notions of 
academic identity” (p. 439). She observed that kindergarten students were “.. .more likely to 
be framed as smart if parental expectations closely align with those of the teacher.” Although 
Hatt’s qualitative methodology does not permit generalization, it is fascinating to read an 
account where students’ socio-economic and racial backgrounds contribute to a situation 
where they “.. .learn early on school is not where they belong or worth investing in, so they 
begin to disengage” (p. 456). 

Non-cognitive assessment of student attitude and affect is an emerging field in 
Canada. The province of Alberta is using the Tell Them From Me instrument 
(http://www.theleamingbar.com/about.php) applied to grade, school and jurisdiction cohort 
measures as part of a province-wide pilot project to inform high school completion strategies. 
The Student Orientation to School Questionnaire (SOS-Q), noted above, measures a range of 
students’ experiences in school and beyond that may affect the observable outcomes, such as 
low engagement, attendance, achievement and high school completion. The instrument 
makes it possible to evaluate student disposition toward school at multiple levels - individual 
students, school, or the jurisdiction. The SOS-Q was developed and tested by researchers at 
the Alberta Department of Education in cooperation with the Parkland School Division 
(Nadirova, Burger, Clarke and Mykula, 2008) and subsequently was acquired by the 
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Educational Testing Service (ETS) for marketing and administration support (see 
http://www.etscanada.ca/afl/sosprogram) . 

Nadirova and Burger (2012) recently demonstrated that Grade 9 student achievement 
in Mathematics and Language Arts measured by standardized provincial achievement tests 
was significantly lower for students manifesting lower scores on the SOS-Q. Furthermore, 
their research demonstrates that student orientation to school measured by the SOS-Q with 
Grade 9 students has a strong predictive relationship to high school completion three years 
later. In this analysis, students scoring in the top quartile of the SOS-Q scale had an 85.9% 
high school completion rate three years after entering Grade 10 whereas students scoring at 
the bottom had a 61.3% completion rate - a 24.6% difference! Therefore, it is clear that 
diagnostically assessing and acting on student attitude at the individual or cohort levels can 
significantly support student academic success. 

Rocky View Schools (Burger, Cardinal, Hennig, Valerio, Ziegler, and Nadirova, 

2012) is engaging in action research on innovative ways to measure students’ affective school 
experience using the SOS-Q. Initially focusing on cohort analysis, the SOS-Q was 
administered anonymously to students in five RVS schools. As one of the principals 
observed, 

While we use many sources of data to help us evaluate our success in the 
area of instructional design, measuring school culture, specifically how 
students perceive themselves fitting into the culture, is more elusive. The 
SOS Q has helped us by providing specific feedback in this area. Our goal 
to build a culture that allows students to thrive in a faith context has 


everything to do with building a safe and caring school, individual self- 
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confidence flowing from understanding themselves in light of faith and 
leadership, building both internal and external resilience, finding purpose in 
life while seeing a connection between school and that purpose, and 
experiencing positive peer relationships. These are all areas measured by the 
SOS Q and the feedback we receive from this instrument is one more tool 
we use to assess our success as a school. As we move forward with the use 
of this survey, we see potential value in using the instrument to identify 
specific students who are not experiencing the culture we intend for them. 

We will then be able to address the areas where they do not feel supported 
and work diligently to fill the gaps, ensuring that every student feels valued. 

The use of the SOS Q is all about ensuring we are actually living our 
mission. (Burger, et.al., 2012, p. 28) 

Current research, supported with a grant from the Alberta School Community 
Wellness Fund, involves over 4000 RVS upper elementary, junior and senior high students 
who have been administered the SOS-Q with an opportunity for voluntary self-identification 
to permit individual follow-up. A key objective of this research is to identify supports or 
strategies to enhance school connectivity for students who manifest weak orientation to 
school. Taines (2012) has reported positive results of a qualitative study where student 
involvement in school activism generated stronger school connectivity, especially for mild 
and moderately alienated students. The on-going RVS research with the SOS-Q will provide 
an opportunity to build on the research reported by Taines and others, while also providing 
information on the benefits and risks of including data on student affect as a standard resource 
in the RVS student information system. 
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Evidence-Based Leadership 

Education is too important to leave to chance or primarily intuitive and single-method 
ways of assessing and programming for students. While teachers know their students best 
through the day-to-day interaction in the classroom, mostly intuitive and informal ways of 
knowing students has its limitations that can be rectified with the addition of formal 
assessment data and specialized and articulated student information. 

In an applied research study that investigated the relationship between student data analytics 
and leadership, Burger, Nadirova, Gonnet, Brandon & Gameau (2011), observed that leadership 
standards at both the school and jurisdiction level were useful in structuring educational leadership; 
however, leadership was enhanced when it was supported with data analytic processes. They noted 
that, “...provincially-mandated, systematically collected accountability and value-added data can be 
used to inform and facilitate district and school-level decision-making” (p. 257). For example, 

One of the important features of comprehensive data systems is the opportunity to 
provide an integrated picture of a district’s student population and associated 
environment. Charting a comprehensive district profile using solid evidence is 
essential for better understanding of local contexts where students and educators 
interact. (Burger, et. al., 2011, p. 257) 

Grande Prairie School District’s data were compared with provincially collected 
data for key variables including: socio-economic status indicators, student mobility, 
student special needs profiles by disability classifications, Grade Level of Achievement 
trend data in Language Arts and Mathematics, high school achievement data by 
curricular stream, relationships between Grade 6 and 9 provincial achievement tests 
results related to high school course stream selection, and lastly, relationships between 
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high school course stream and high school completion rates. As an outcome of these 
extensive, value-added data analytics, the researchers concluded that 

...the opportunities and challenges in making data and evidence-informed 
decision making a central component of leadership at all levels of the 
education system is of fundamental importance. This chapter has 
illustrated how educational leadership is being enhanced in Alberta by 
linking it to more comprehensive, current, accessible and balanced 
(internal and external) data with practical applications at the school and 
jurisdiction levels, supported by an enhanced data warehouse maintained 
by the Department of Education. Value-added data analysis by school and 
district leaders supported by emerging leadership standards and support 
networks are in the early stages of development. These efforts, however, 
promise a future where leadership behaviors are better understood through 
the enhanced inter-connectivity of leaders’ critical reflection focused on 
success for all students. (Burger, et. al., 2011, p. 265) 

Moving forward, similar to the way that qualitative and quantitative research methods 
are being applied in complementary ways to form more practical and effective mixed 
methods of understanding and conducting education research, intuitive and more formalized 
approaches to measuring the full range of students’ learning styles can be developed and 
applied by school and central office leaders. A key strategy in the RVS 2011-14 Three Year 
Education Plan is to “accelerate innovation, research, and organizational development to 
achieve operational efficiencies.” A system-wide, balanced, and integrated student 
information system that supports timely diagnostics of individual student achievement and 
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incorporates data at the classroom, school, and jurisdictional levels is key to achieving this 
outcome. 

Student Self-Assessment and Reflection 

Hart (2012) depicts how teachers’ perceptions of their students can be subjective and 
influenced by extraneous factors. Such research supports the view that the learners need to 
understand where they are in their learning in a meta-cognitive context, that is, having the 
knowledge, ability and opportunity to reflect on how to use particular strategies for learning or for 
problem solving. Stiggins (2001) presents compelling arguments for active student involvement in 
assessment. Essentially, versatile data that can engage students in understanding their learning 
styles, strengths and challenges present important opportunities to support students’ meta-cognition. 

Rocky View staff has considered how to connect formative and qualitative student data in the 
Individual Learner Profile developed with the student, in relationship to multiple levels of 
quantitative student data collection applied across student, classroom, school and jurisdiction 
boundaries. 


Building the Student Information System 

The diagram in Figure 1 represents a balanced and holistic model of student information. 
This diagram demonstrates how a comprehensive and balanced student information system can 
provide crucial information at multiple levels of a school jurisdiction. 
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Figure 1. Rocky View Schools Student Information System Model 
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RVS is developing a Student Information System which will be supported with Pearson’s 
Power School software. Staff capacity is being further developed to make maximum use of 
such rich information. 

As discussed above, the student data required to improve learning must be systemic, 
holistic, balanced between classroom and external assessments as well as formative and 
summative methods, and include achievement, ability, aptitude, interests and attitude 
measures. The highly variable grade structures between Rocky View schools make the 
implementation of systemic data approaches challenging. For example, administering a 
group ability test in Grade five may be ideal for a grade 5-8 middle school but would not 
provide ability data to a k-4 elementary school. Therefore, a flexible approach is needed to 
define the specific instrumentation underlying the Student Information System. A potential 
model is presented in Table 1 as a draft of the key internal classroom and external inputs to a 
Student Information System. In addition, jurisdictions should have standard report card 
formats and/or reporting protocols for grade divisions 1 through 4 to support standard 
classroom-based achievement data input to the SIS. Table 1 defines a timeline and estimated 
costs of one example of a system-wide student data collection framework. 
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Table 1. 


Potential Components of a Student Information System 


Grade 

Time Line 

Cost 

Measure - Instrument 


(date available) 

(estimate per student) 

ECS- 

June 

Internal 

Early Years Evaluation Measure 

K 



httD://earlvvearsevaluation.com/EN/ 

One 

June 

Internal 

Report card marks/Grade Level of Achievement (GLA) 

Two 

October 

$5.50 

Canadian Achievement Test 4 - Level 11 
httD://www.canadiantestcentre.com/CAT4/CAT4.asD 


June 

Internal 

Report card marks/GLA 

Three 

June 

Internal 

Report card marks/GLA 

Four 

September 

Internal 

Provincial Achievement Tests-3 


October 

$2.57 

Student Orientation to School -Questionnaire 
http://www.etscanada.ca/afl/sosDrogram 


June 

Internal 

Report card marks/GLA 

Five 

October 

$11.00 

CTC - Insight Level 2 

http://www.canadiantestcentre.com/insight/insight.asp 


June 

Internal 

Report card marks/GLA 

Six 

June 

Internal 

Report card marks/GLA 

Seven 

September 

Internal 

Provincial Achievement Tests-6 


October 

$2.57 

Student Orientation to School-Questionnaire 


June 

Internal 

Report card marks/GLA 

Eight 

June 

Internal 

Report card marks/GLA 

Nine 

November 

$8.00 

Differential Aptitude Test (DAT) 
http://www.creativeorgdesign.com/tests page.htm?id=84 


June 

Internal 

Report card marks/GLA 

Ten 

September 

Internal 

Provincial Achievement Tests-9 


October 

$2.57 

Student Orientation to School -Questionnaire 


June 

Internal 

Course marks 

Eleven 

October 

$2.00 

MyBlueprint Interest Inventory/Education Planner 
http://www.mvblueprint.ca/discoverv-explorations/ 


June 

Internal 

Course marks 

Twelve 

June 

Internal 

Course marks 


October 

TBD 

Tell Them From Me - Questionnaire 


September 

Internal 

Diploma exam marks 

Total estimated cost 
per student-k-12 

$31.71 
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Benefits 

Development and implementation of a state-of-the-art Student Information System 
proffers a number of exciting benefits that will support a school jurisdiction’s goals and 
strategies to evolve as a 21 st century learning organization grounded in meaningful student 
data. 

• Rich information is available for improved student diagnostics and evidence-informed 
decision-making and educational leadership at the school and Division levels. 

• Nested (school and system) leadership for school improvement is supported with better 
empirical evidence. 

• New Student Information System technology (Power School) is enriched with multiple types 
of data on multiple student factors that influence student achievement. 

• Student Information System training is more effective and meaningful with more holistic, 
relational data that provides broader insight into optimal student programming and supports 
student metacognitive approaches to their learning. 

• Enriched data supports diagnosis of strengths and weaknesses and helps ensure students’ 
needs are better met and kids do not “fall through the cracks.” 

• Educational research is better supported with contextually relevant, relational data. 

Conclusion 

This paper on the design and implementation of a cutting edge student information system 
represents an opportunity to stimulate discussion and further development in a strategically crucial 
area of educational measurement. Balanced student assessment empowered by new assessment tools 
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and technologies will support optimal levels of student growth and achievement in ways we have 
only begun to imagine. 
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